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AMENDMENTS TO THE CLAIMS 

1. (Currently amended) An analysis system, comprising: 

a plurality of sensors configured to collect perception evidence; 
a computer system comprising a perception system that, when executed, consumes 
computing resources of the computing system, the perception system comprising: 

a control component that selectively gathers from the plurality of sensors the 
perception evidence , the perception evidence being gathered at times selected to limit 
utilization of the computing resources of the computer system by [[a]] the perception 
system; and 

an analysis component that utilizes an analysis policy to analyze the perception 
evidence to determine a context of a user of the computer system obtained for 
employment in^ 

wherein: 

the analysis component is interactive with the control component fef uses 
information from the analysis component regarding at least one feature about 
which to collect data to select the times at which to gather perception evidence 
from one or more of the plurality of sensors; and analysis operations 

the analysis component generates the information based on a value of the 
at least one feature for determining the context . 

2. (Original) The system of claim 1, the analysis component employing, at least in 
part, learned inferences relating to persistence versus volatility of observational states to account 
for unobserved data. 

3. (Original) The system of claim 2, the learned inferences based, at least in part, on 
a probability distribution over future states based on at least one previously observed value that 
is captured by at least one function of time. 
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4. (Original) The system of claim 3, the probability distribution comprising a 
Gaussian distribution: 

where pi is a mean value and a(f) is a standard deviation at time "f." 

5. (Original) The system of claim 1, the control component employing a criticality 
level of at least one user task to limit utilization of computing resources by the perception 
system. 

6. (Original) The system of claim 1, the control component limiting utilization of 
computing resources based upon context. 

7. (Original) The system of claim 1, the control component limiting utilization of 
computing resources by controlling what analysis policy is employed. 

8. (Original) The system of claim 7, the selection of the analysis policy based on 
context information. 

9. (Original) The system of claim 1, further comprising at least one perception 
sensor to provide the perception evidence for the perception system. 

10. (Original) The system of claim 9, the control component limiting utilization of 
computing resources by facilitating control of at least one selected from the group consisting of 
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an analysis process for at least one perception sensor and a focus of attention of at least one 
perception sensor. 

1 1 . (Original) The system of claim 9, the control component limiting utilization of 
computing resources by controlling what perception sensors are employed. 

12. (Original) The system of claim 9, the perception sensor comprising at least one 
selected from the group consisting of a video camera, an audio microphone, a keyboard 
keystroke sensor, a mouse utilization sensor, and a motion detector. 

13. (Original) The system of claim 9, the perception sensor comprising a detector for 
at least one state of at least one selected from the group consisting of at least one data structure 
within a computing system and at least one application activity within a computing system. 

14. (Original) The system of claim 1 , further comprising a user interface component 
that interfaces with at least one user to relay information relating to user perception preferences 
to the perception system. 

15. (Original) The system of claim 14, the control component employing at least one 
user perception preference to limit utilization of computing resources by the perception system. 

16. (Original) The system of claim 14, the user perception preferences comprising 
values of cost for utilizing computing resources. 

17. (Original) The system of claim 1, the perception evidence analysis operations 
comprising analysis policy selection control operations between the control component and the 
analysis component. 



Application No. 10/729,464 
Amendment dated August 24, 2009 
Reply to Office Action of April 22, 2009 



5 



Docket No.: Ml 103.70734US00 



18. (Original) The system of claim 1, the perception evidence analysis operations 
comprising perception evidence related information exchanges between the control component 
and the analysis component. 

19. (Original) The analysis system of claim 1 utilized to design an analysis policy of 
at least one perception system and its perception sensors. 

20. (Original) The analysis system of claim 1 utilized to determine at least one value 
of adding at least one sensor to at least one perception system. 

21. (Original) The analysis system of claim 1 utilized to provide information relating 
to volatility of data due to influences of a flow of time. 

22. (Original) The analysis system of claim 1 utilized to determine at least one time- 
based economic value of a business given its environmental context. 

23. (Original) The system of claim 1, the analysis policy comprising a context-based 
analysis policy. 

24. (Original) The system of claim 1, the analysis policy comprising a random 
selection perception policy that randomly selects which features to utilize on a frame by frame 
basis. 

25. (Original) The system of claim 1, the analysis policy comprising a rate-based 
perception policy that defines observational frequencies and duty cycles for at least one feature. 
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26. (Original) The system of claim 25, the rate-based perception policy utilizing off- 
time that is determined by cross-validation means on a real-time data validation set to determine 
time for computations. 

27. (Original) The system of claim 1, the analysis policy comprising an EVI-based 
perception policy that determines an expected value of information via a cost-benefit analysis 
means utilizing at least expected values and cost of analysis values for at least one feature. 

28. (Original) The system of claim 27, the cost of analysis values comprising at least 
one value proportional to an impact to the computing resources employed by the perception 
system. 

29. (Original) The system of claim 27, the EVI-based perception policy employing a 
context-based cost model to determine the cost of analysis values. 

30. (Original) The system of claim 27, the EVI-based perception policy employing 
real-time computations of expected value of information. 

31. (Original) The system of claim 30, the real-time computations processed utilizing 
a myopic, single step approach for computing a next best set of observations. 

32. (Original) The system of claim 27, the cost of analysis values comprising at least 
one selected from the group consisting of dollar values, percentage of CPU utilization values, 
latency values, and user selected preference values. 

33. (Original) The system of claim 27, the cost-benefit analysis means utilizing 
substantially similar value types for a cost value and a benefit value to calculate the expected 
value of information. 
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34. (Original) The system of claim 27, the cost-benefit analysis means further 
comprising at least one utility model that facilitates in analyzing a benefit of determining a value 
of at least one feature. 

35. (Original) The system of claim 34, the utility model comprising a conditional 
utility model that alters functionality dependent upon context. 

36. (Currently amended) The An analysis system of claim 3 4. comprising 

a control component that selectively gathers perception evidence to limit utilization of 
computing resources by a perception system; and 

an analysis component that utilizes an analysis policy to analyze the perception evidence 
obtained for employment in the perception system; wherein 

the analysis component is interactive with the control component for perception 
evidence analysis operations, 

the analysis policy comprises an EVI-based perception policy that determines an 
expected value of information via a cost-benefit analysis means utilizing at least expected values 
and cost of analysis values for at least one feature, 

t he cost-benefit analysis means comprise at least one utility model that facilitates 
in analyzing a benefit of determining a value of the at least one feature, 

the utility model comprises a conditional utility model that alters functionality 
dependent upon context, and 

the expected value of information is_determined, at least in part, via utilization of 
Equation (2): 



EVI(f k ) = EV(f k )~ max £/>(M . I E)U(M (J M j)-cost(f k ) 

j 



Eq. (2) 



Application No. 10/729,464 
Amendment dated August 24, 2009 
Reply to Office Action of April 22, 2009 



8 



Docket No.: Ml 103.70734US00 



where EVI(f k ) is the expected value of information for perceptual feature combination/*, EV(f k ) is 
an expected value of /* based on observed evidence, E represents previous observational 
evidence, £/(Af,-, Mj) is a utility of assessing a value of asserting that real-world state Mi is Mj, and 
cost(f k ) is a computational cost associated with computing feature combination/*. 

37. (Original) The system of claim 27, the EVI-based perception policy further 
comprising a probabilistic model. 

38. (Original) The system of claim 37, the probabilistic model comprising a Hidden 
Markov Model (HMM) model. 

39. (Original) The system of claim 38, the expected value of information determined, 
at least in part, via Equation (4): 



/ 



m a x^U(M i ,Mj)p(M J )d 0 fk 

J 

- max £ U (M . , M . ) />(M . ) - cw/ (0 * ) Eq ' (4) 

where EVI(f k ) is the expected value of information for perceptual feature combination /*, " (^) 
is an alpha or forward variable at time / and state s in a standard Baum-Welch algorithm, a n sl is a 

f 

transition probability of going from state s to state /, and b" (O t+] k ) is a probability of observing 

f 

0;+ { k in state /, all of them in model M„, U(Mi 9 Mj) is a utility of assessing a value of asserting 
that real-world state M, is My, and /" , m = 1 ... M to denote all possible values of a feature 
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f 

combination/*, and cost(Of +} k J is a computational cost associated with computing observations 



f m 



40. (Original) The system of claim 38, the expected value of information determined, 
at least in part, via discretized Equation (5): 

EVI « ZZ[I<(*)I«X(0,£' W(M n ) 

m n s t 

1 j 

- max (M n M j)p(M j)- cost (O,^) Eq ' ^ 

' j 

where EVI is the expected value of information, a " (s) is an alpha or forward variable at time t 
and state s in a standard Baum-Welch algorithm, a n sl is a transition probability of going from 

state s to state /, and b" {of+ x k ) is a probability of observing of +x k in state /, all of them in model 
M rt , t/(M„ Mj) is a utility of assessing a value of asserting that real-world state M, is M/, and , 

m = 1 ... M to denote discretized values of a feature combination/*, and cost{ Of +] k j is a 

f m 

computational cost associated with computing observations 0,*;,* . 



41. (Original) The system of claim 37, the probabilistic model comprising a Layered 
Hidden Markov Model (LHMM) model. 
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42. (Original) The system of claim 41, the Layered Hidden Markov Model (LHMM) 
utilized to substantially reduce re-training of higher level layers when an operating environment 
change occurs. 

43. (Currently amended) A method of analyzing data, comprising: 
obtaining perception evidence for a perception system for a particular context; 
analyzing the perception evidence utilizing an analysis policy to determine a perceived 

system value; and 

employing the perceived system value to limit utilization of computing resources of a 
computer system by the perception system by determining whether to obtain the perception 
evidence based on the determined perceived system value, wherein a time at which the 
perception evidence is obtained is selected based on an intensity of interaction of a user with the 
computer system . 

44. (Original) The method of claim 43, analyzing the perception evidence further 
comprising: 

employing, at least in part, learned inferences relating to persistence versus volatility of 
observational states to provide unobserved perception evidence in lieu of observed perception 
evidence. 

45. (Original) The method of claim 44, the learned inferences based, at least in part, 
on a probability distribution model for future states based on at least one previously observed 
value that is captured by at least one function of time. 

46. (Original) The method of claim 45, the probability distribution model 
comprising, at least in part, a Gaussian distribution: 
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(2*o(0 2 ) l/2 1 2o(0 2 J 
where /ms a mean value and cr(0 is a standard deviation at time "f." 

47. (Original) The method of claim 43, further comprising: 

accepting user input to obtain user preferences to establish criteria for limiting utilization 
of the computing resources by the perception system. 

48. (Currently amended) The method of claim 47, the criteria comprising at least one 
critical task that supersedes analysis of perception evidence for the at least one feature in a given 
context. 

49. (Original) The method of claim 43, further comprising: 

employing at least one perception sensor to obtain the perception evidence; and 
extracting perception evidence pertaining to at least one feature from the perception ■ 

sensor. 

50. (Original) The method of claim 49, further comprising: 

selecting what perception sensors are employed to obtain perception evidence to further 
optimize the limiting of the computing resources employed by the perception system. 

51 . (Original) The method of claim 49, further comprising: 

selecting when perception sensors are employed to obtain perception evidence to further 
optimize the limiting of the computing resources employed by the perception system. 

52. (Original) The method of claim 49, at least one perception sensor comprising 
perception evidence for at least one feature. 
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53. (Original) The method of claim 43, further comprising: 

selecting the analysis policy based on optimization of limiting computing resources for a 
given context. 

53. (Original) The method of claim 43, further comprising: 

selecting the analysis policy based on optimization of limiting computing resources for 
obtaining a desired feature. 

55. (Original) The method of claim 43, employing the perceived system value 
comprising utilizing computing resources when the perceived system value is above a threshold. 

56. (Original) The method of claim 43, employing the perceived system value 
comprising utilizing computing resources for a feature combination that yields a maximal 
perceived system value. 

57. (Original) The method of claim 55, the threshold is a predetermined threshold. 

58. (Original) The method of claim 57, the predetermined threshold is set via a user 
preference. 

59. (Original) The method of claim 57, the predetermined threshold is set via the 
perception system based on context. 

60. (Original) The method of claim 43, the analysis policy comprising a rate-based 
perception policy. 



61. 



(Original) The method of claim 60, further comprising: 
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defining observational frequencies and duty cycles via a cross-validation means on a real- 
time data validation set for perception sensors employed by the perception system; and 

determining which perception sensors are providing sensed data and utilizing the sensed 
data to compute features facilitated by the sensed data. 

62. (Original) The method of claim 61, further comprising: 

adapting the observational frequencies and duty cycles for at least one sensor 
dynamically. 

63. (Original) The method of claim 43, the analysis policy comprising a random 
selection-based perception policy. 

64. (Original) The method of claim 63, further comprising: 

determining features available based on available perception sensors employed by the 
perception system; 

randomly selecting which features to analyze; and 

processing at least one analyzed feature to determine output perception data. 

65. (Original) The method of claim 43, the analysis policy comprising an EVI-based 
perception policy. 

66. (Original) The method of claim 65, further comprising: 
calculating a benefit value for determining a feature; 
calculating a cost value for determining the feature; and 

utilizing the EVI-based perception policy to derive a cost-benefit analysis value of the 
feature; the cost benefit analysis utilizing a benefit value and a cost value. 
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67. (Original) The method of claim 66, the benefit value and the cost value 
calculated employing a substantially similar value type. 

68. (Original) The method of claim 67, the value type comprising at least one 
selected from the group consisting of a dollar value, a percentage of CPU utilization value, a 
latency value, and a user-selected value. 

69. (Original) The method of claim 65, the EVI-based perception policy further 
comprising at least one selected from the group consisting of a utility model and a probabilistic 
model. 

70. (Original) The method of claim 69, further comprising: 

evaluating an expected value of information (EVI) utilizing, at least in part, employment 
of Equation (2): 

EVI(f k ) = EV(f k )- max £/>(M . I E)U(M n M j)-cost(f k ) Eq. (2) 

where EVI(f k ) is the expected value of information for perceptual feature combination/*, EV(f k ) is 
an expected value off k based on observed evidence, E represents previous observational 
evidence, f7(M„ Mj) is a utility of assessing a value of asserting that real-world state Af, is Mj, and 
cost{f k ) is a computational cost associated with computing feature combination/*. 

7 1 . (Original) The method of claim 69, the probabilistic model comprising a Hidden 
Markov Model (HMM). 

72. (Original) The method of claim 71, further comprising: 

evaluating an expected value of information (EVI) utilizing, at least in part, employment 
of Equation (4): 
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EVI(f k ) - |XtS<WZ<A W (^)]P(M fl ) 

n s i 
J 

-max ^^(A/ ( ,M .)p(M ; )-c^r(0^) Eq * (4) 

where EVI(f k ) is the expected value of information for perceptual feature combination f k , a " (5) 
is an alpha or forward variable at time / and state s in a standard Baum- Welch algorithm, a n 5l is a 

f 

transition probability of going from state s to state /, and b" (O t J ^ k ) is a probability of observing 

r 

O t J +l k in state /, all of them in model M n , t/(Af,, A//) is a utility of assessing a value of asserting 
that real- world state M, is My, and/7 , m = 1 . . . M to denote all possible values of a feature 

f 

combination and cost(Of +l k j is a computational cost associated with computing observations 
73. (Original) The method of claim 71 , further comprising: 

evaluating an expected value of information (EVI) utilizing, at least in part, employment 
of discretized Equation (5): 

EVl « S I £ (<>,{.' >]w.) 

m n s t 

max£tf(M,,M,.)p(M,.) 
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where EVI is the expected value of information, a " (s) is an alpha or forward variable at time t 
and state s in a standard Baum-Welch algorithm, a n sl is a transition probability of going from 

f m f m 
state s to state /, and b"(Of +] k ) is a probability of observing Of +l k in state /, all of them in model 

M„, £/(Af;, Afy) is a utility of assessing a value of asserting that real- world state M, is My, and/7 , 

f 

m = 1 ... M to denote discretized values of a feature combination and casr( O^,* J is a 

f 

computational cost associated with computing observations Of +l k . 



74. (Original) The method of claim 69, the probabilistic model comprising a Layered 
Hidden Markov Model (LHMM). 

75. (Original) The method of claim 74, further comprising: 

employing lower level layers of the LHMM to mask higher level layers from needing to 
be re-trained when the perception system is changed to a new environment. 

76. (Original) A perception evaluation system utilizing the method of claim 43 to 
determine benefits of additional perception sensors to a perception system. 

77. (Original) A perception design system utilizing the method of claim 43 to design 
a perception system to optimally limit utilization of computing resources. 



78. (Original) A perception response system employing the method of claim 43 to 
provide information utilizing knowledge of volatility of data due to influences of a flow of time 
to re-determine perceptions at appropriate intervals. 
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79. (Currently amended) A data analysis system, comprising: 
sensor means to collect perception evidence; 

control means to control the plurality of sensors to selectively gather the perception 
evidence obtained for employment via a perception system to limit utilization of computing 
resources of a computer system by the perception system; and 

analyzing means to analyze the perception evidence utilizing an analysis policy to 
determine context of use of the computer system by one or more users in which the perception 
system is operating, wherein the analyzing means is employed to guide the control means 
facilitate in regarding which features to collect by the sensor means as the perception evidence 
depending on a value of the features for limiting of the utilization of the computing resources by 
the perception system . 

80. (Currently amended) A data analysis system, comprising: 

a first component of a perception system that receives adata queries query relating to 
obtained dat a to determine a context in which the perception system is operating so that to limit 
utilization of computing resources of a computer system by the perception system, wherein the 
data comprises perception evidence pertaining to at least one feature collected by a plurality of 
sensors ; and 

a second component that analyzes volatility versus persistence of observations of at least 
one state of the obtained data with regard to volatility of the data over time to establish 
reasonableness in timing of at least one query reply to the query, wherein 

the plurality of sensors collect the perception evidence pertaining to the at least 
one feature based on a value of the at least one feature in the context, and 

selection of the at least one feature depends on an intensity of interaction of a user 
with the computer system . 

81. (Cancelled) 
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82. (Original) A computer readable medium having stored thereon computer 
executable components of the system of claim 1. 

83. (Original) A device employing the method of claim 43 comprising at least one 
selected from the group consisting of a computer, a server, and a handheld electronic device. 

84. (Original) A device employing the system of claim 1 comprising at least one 
selected from the group consisting of a computer, a server, and a handheld electronic device. 



